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SPECIFICATION 



3-D Forward looking sonar with Fixed Frame of Reference for Navigation 

Priority 

Priority is claimed to US patent application Serial Number 60/419,728, which was 
5 filed on October 21, 2002 and 10/177,889, which was filed October 22, 2002. 

Background 

There are many types of sonar systems used for military, commercial, and 
recreational purposes. Generally, forward looking sonar systems are designed to build a 2 
dimensional image along a single vertical or horizontal slice. More advanced systems are 
10 capable of building 3 dimensional images through a series of 2 dimensional pings pointed 
.directly below the vessel with the direction of the 2 dimensional strip being perpendicular 
to the track of the vessel. This type of system is downward-looking and used for bottom 
mapping. At present commercial forward-looking navigation sonars in creating a 3 
dimensional image from a single ping, having any array geometry are unknown. 

15 In the field of interferometry, arrays of many receivers are used, which enable a 

user or an autonomous system controller to make precise angular measurements for long- 
range detection, imaging, object classification, obstacle avoidance, etc. The operating 
frequencies can vary between a few Hz for seismic applications to many Megahertz or 
Gigahertz for ultrasound and radio systems. The sensors are usually arranged in an array 

20 in order to improve the signal to noise ratio for better detection. In such an array, the 
receiver hardware must be replicated for each channel. Since the number of array 
elements can vary from a minimum of four to several thousand, the cost for the receiver 
hardware can be a real burden. Furthermore, in order to perform the additional 
operations required for detection, for example: beam forming and multi-beam processing; 

25 each sensor output must be connected to a central signal processor. Depending on the 
number of array elements, this can create a serious wiring burden. Finally, since the 
sensors detect analog signals while the central processing unit operates in the digital 
domain, each channel must be equipped with a high-resolution analog-to-digital 
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converter (ADC). The complexity of these systems limit the ability to provide for 
upgrades and modifications and render repairs expensive. 

Many accidents could have been avoided if the mariners were equipped with a 3 
dimensional, forward-looking, bottom mapping and obstacle detection sonar with a fixed 
5 frame of reference for navigation. To be navigationally effective, the sonar must have a 
fast update rate. Depending on their size and sea conditions, ships can tilt and roll so 
much that the depths of obstacles including the seafloor detected with a phased array 
sonar can be tens of meters in error. Therefore, not only is advantageous to generate the 3 
dimensional image with a single or small number of pings, it is also advantageous to 
10 display the image with a fixed frame of reference. 

Summary of the Invention 

A forward looking (side looking, or bottom looking) sonar system has the 
following features. A transmit transducer projects a signal into the water ahead of the 
vessel. A phased array of receiving sensors provides signals to a computer which 

15 determines the azimuthal and elevation angles of arrival and time of arrival. This sonar is 
equipped with tilt and roll sensors and may be interfaced with GPS and a compass. The 
acoustic information along with the tilt and roll can be processed to create a 3-D image 
ahead of the vessel with a fixed frame of reference relative to the earth from the raw 
beamformed data. This is necessary in understanding the picture ahead of the vessel. By 

20 including heading and GPS sensors and information the images can be fixed to a specific 
location on the earth. This is necessary many displays such as historical mapping and 
chart overlay. Advanced signal processing techniques enable the processor to extract 
targets from the raw beamformed data. Additional features of the system enable the 
suppression of many multipath targets. 

25 Brief Description of the Drawings 

Figure 1 is a block diagram of the sonar system. 

Figure 2 is an example of fixed frame of reference where underwater obstacle is 
shown relative to the earth and the depth estimate without pitch sensor. 
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Figure 3 is an illustration of the beampatterns and beam steer angles of a broad 
beam transmitter and a narrow beam receiver. 

Figure 4a is an example block diagram of a system architecture with one 
processor and multiple interfaces. 

5 Figure 4b is an example block diagram of a system architecture with multiple 

processors and multiple interfaces. 

Figure 5 is a flow chart of the target detection, display, and interface process. 

Figure 6 illustrates the spatial selection of receive beam to include a given volume 
of interest. 

10 Figure 7 illustrates depth thresholds for surface clutter removal. 

Figure 8 illustrates a two dimensional vertical slice through beamformed data 
with and withought a boat noise removal filter. 

Figure 9 illustrates the use of a line of sight correction filter along a 2D depth 

profile. 

15 Figure 10a illustrates the elimination of false targets due to multipath reflections 

through the integration of vertical resolution. 

Figure 1 Ob illustrates the elimination of false targets due to multipath reflections 
through the integration of horizontal resolution. 

Figure 1 1 illustrates a 2D slice extracted from 3D beamformed sonar data with 
20 color mapped to signal strength and with processed bottom extracted from the 
beamformed data which is drawn inconjunciton with the raw beamformed data. 

Detailed Description of the Invention 

The invention will be described in connection with certain preferred 
embodiments, with reference to the following illustrative figures so that it may be more 
25 fully understood. With reference to the figures, it is stressed that the particulars shown 
are by way of example and for purposes of illustrative discussion of the preferred 
embodiments of the present invention only, and are presented in the cause of providing 
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what is believed to be the most useful and readily understood description of the principles 
and conceptual aspects of the invention. In this regard, no attempt is made to show 
structural details of the invention in more detail than is necessary for a fundamental 
understanding of the invention, the description taken with the drawings making apparent 
5 to those skilled in the art how the several forms of the invention may be embodied in 
practice. 

A block diagram of the preferred embodiment of a forward looking sonar is 
shown in figure 1. A forward looking (side looking, or bottom looking) sonar system has 
the following features. Referring to figure 1, a transmit transducer 110 projects a signal 

10 into the water ahead of the vessel. A phased array of receiving sensors 1 12 provides 

signals to a computer which determines the azimuthal and elevation angles of arrival and 
time of arrival. This sonar is equipped with tilt and roll sensors 103 and may be 
interfaced with GPS 101 and a compass 102. The acoustic information along with the tilt 
and roll can be processed to create a 3-D image ahead of the vessel with a fixed frame of 

15 reference relative to the earth. This is necessary in understanding the picture ahead of the 
vessel. By including heading and GPS sensors and information the images can be fixed to 
a specific location on the earth. This is necessary many displays such as historical 
mapping and chart overlay. 

Depending on their size and sea conditions, ships can tilt and roll so much that the 
20 depths of obstacles including the seafloor detected on a phased array sonar can be tens of 
meters in error. The fixed frame of reference 3-D sonar allows the mariner to observe 
potential obstacles in the context the volume of water ahead of their ship relative to the 
sea surface and/or the sea floor. 

Fixed frame of reference means that the sonar data is plotted relative to a 
25 stationary body which allows the user to better understand the image. In the preferred 
embodiment, the fixed frame of reference is the center of the earth. As an example, it is 
preferred that the sea floor is always stationary in the sonar system's display. 

A positioning system such as Global Positioning System (GPS) or Loran is used 
to collect location information. This location information is used in conjunction with 
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direction information to position the sonar data relative to a geographical location on 
earth. This geographical relationship is needed for best results in applications that require 
geo-referencing such as overlaying the sonar data on a nautical chart, creating 
cartographical maps, building historical data charts, ping to ping correlation, sonar 
5 routing archiving and replaying, and other GIS based data collection. Once a geo- 
referenced sonar image is made, positioning information can be used to update the 
position of the vessel graphic in the sonar data display relative to the position of the sonar 
data. This component of the system is optional. 

Additionally, processing a 3 dimensional image enable other advantages such as 
10 removing multipath targets from above the sea surface, behind walls and below the sea 
floor. 

Referring to figure 1, the preferred embodiment of the invention includes a 
direction sensor 102. The direction information may be derived from GPS, a compass, 
dead reckoning, or other standard navigation technique. Direction information is needed 
15 for best results in applications that require geo-referencing such as overlaying the sonar 
data on a nautical chart, creating cartographical maps, building historical data charts, ping 
to ping correlation, sonar route archiving and replaying, and other GIS based data 
collection. This component of the system is optional. An optional yaw sensor may be 
included in correcting the direction information from the direction sensor. 

20 Overlaying geo-referenced sonar information on other types of geo-referenced 

data such as nautical chart data, as described in US Patent Application 10/177,889 which 
was filed on October 22, 2002, and is hereby incorporated by reference as fully set forth 
in is entirety herein, is optionally part of the preferred embodiment of the invention. In 
this embodiment, the sonar data is drawn on top of other information. Additionally, other 

25 geo-referenced information may also be drawn on top of the sonar data. The information 
may be displayed to the user in the form of multiple image layers such as is common in 
many CAD programs. The sonar layers may be shown as 3 dimensional surfaces, 2 
dimensional projections of the 3 dimensional information, icons representing features in 
the sonar data, other representations as described in US Patent Application 10/177,889, or 

30 in any combination of the above with any number of filters set to display any sub-set of 
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the data herein. The entire, multi-layer, geo-referenced scene may be displayed in 3 
dimensional perspective view or in plan view. The details of which do not need to be 
discussed as they are well known in the art of multi-layer display systems. 

Cartographical maps can be made from a series of 3 dimensional forward-looking 
5 (or side looking, or downward looking) images. In this embodiment, the geo-referenced 
sonar data is combined onto one image. In placed where pings overlap, the data may be 
averaged, filtered, reprocessed for multi-ping correlation, or selected by any number of 
selection criteria such as age or data, range of data from sonar system, angle or data 
relative to sonar system, signal strength, target strength, vessel stability, transmission 
10 signal type used, or any other type of tiling techniques known in the art of image 
processing. 

In another embodiment, ping to ping correlation may be performed by comparing 
multiple pings covering overlapping areas. The correlation may utilize feature tracking, 
multi-look/snapshot processing, averaging, synthetic aperture processing, or other signal 
15 processing techniques to improve accuracy, improve resolution, track targets, measure 
target properties such as speed, collision detection, time to collision, and course, and 
other oceanographic and acoustic values. Examples of other oceanographic and acoustic 
values include calculating sound speed profiles and calculating vessel characteristics such 
as speed and heading. 

20 In another embodiment, route archiving and replaying may be performed with 

geo-referenced sonar data. In this embodiment, geo-referenced data is saved and can then 
be replayed in a time series overlaid on top of other geo-referenced data. Non geo- 
referenced sonar data can also be saved for playback on array face referenced displays. 

In another embodiment, historical data charts can be built for any geo-referenced 
25 location using a series of geo-referenced sonar images of for the same location. By 
imaging the same area over time, a time dependant image of the area and/or a time 
dependant measurement of the depth can be built. Historical data charts may be useful in 
survey and homeland defense applications. 
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In another embodiment, vessel direction information combined with a speed 
sensor can also be used to update the position of the vessel graphic in the sonar data 
display relative to the position of the sonar data. This allows the position of the vessel to 
be noted as it changes over time relative to the location of the sonar data collected on any 
5 ping or series of pings. This allows for a more complete picture of a vessels relative 
location to features in the environment between updates of the sonar image. This 
technique can also be used to show the vessel's actual position relative to the sonar 
information in realtime even if there is a known delay between the sonar data generation 
and the display to the user. The speed information may be derived from any standard 
10 navigational technique. This component of the system is optional. 

Roll and tilt information for the receive array face relative to the earth is required 
for 3D imaging with a fixed frame of reference. This information can be combined with 
acoustic data to create a 3D image with fixed frame of reference for navigation through 
signal processing as described in US Patent Application 10/177,889. During processing, 

15 the beamformed data which by definition is spatially referenced to the array face is 

rotated using standard coordinate space rotation techniques such as matrix rotations often 
used in digital imaging. In the preferred embodiment, the rotation is performed along 
both the vertical (elevation) and horizontal (azimuthal) axes. The amount of rotation is 
determined by a roll and tilt sensor. The roll and tilt sensor may be based on initial 

20 measurements, electro-mechanical sensors, accelerometers, or any other sensor that is 
able to generate roll and tilt information relative to the earth. Optionally, this sensor may 
include yaw measurements. The update rate of the positioning system, the direction 
sensor, the roll/tilt/yaw sensor, and the speed sensor affects the precision of the 
positioning of the sonar data relative to a fixed frame of reference and geo-referenced 

25 location. Without roll and tilt compensation, targets are placed incorrectly relative to the 
earth as illustrated in figure 2. Targets must be placed correctly for use in navigation. 

Referring to figure 1, the processor 104 takes all of the incoming data. It 
beamforms the acoustic data and creates 3D image relative to the array face. It then takes 
that image and uses the additional data sources to position the sonar data relative to a 
30 fixed frame of reference. For example, if the fixed frame of reference is the earth, the 
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data is first related to the angular position of the earth but relative to the vessel through 
roll, tilt, and, optionally, yaw sensors. The position of the stabilized image is then geo- 
referenced to the earth's position by referencing the vessel's position to the earth and then 
to the sonar system. Commonly, the vessel is referenced to the earth through GPS, dead 
5 reckoning, Loran, long-base-line, short-base-line or triangulation although, any means of 
referencing the vessel's bearing and geo-graphical position is acceptable. 

The processor receives the acoustic data from the data collection system 115. The 
data collection system consists of an array of transducers 1 12 used for receiving 
incoming acoustic signals, analog conditioning electronics 111, and an analog to digital 
10 converter 107. 

All or some of the receive transducers 1 12 may be used as all or part of the 
transmit array 1 10 by means of a Transmit/Receive switch commonly called a T/R 
switch. This array must be 2 dimensional and can be a fully or sparsely populated planar 
or conformal array. In the preferred embodiment, the elements in the array should be 

1 5 spaced at no more than one half the wavelength of the center frequency of the transmitted 
and expected receive signals to ensure that all grating lobes are kept out of real space. 
Great than half-wavelength spacing may be used to create larger array apertures for a 
given number of channels as long as the field-of-view is reduced to keep grating lobes 
out of the beamformed data. In other embodiments, other element spacing schemes such 

20 as logarithmic spacing may be used. In the preferred embodiment, many more than 10 
elements/channels are needed though the same techniques described by these 
embodiments can also be used by any array with fewer channels realizing that smaller 
channel counts may not yield high enough resolution systems for most applications. 
Multiple channels are needed in order to beamform in 2 dimensions. The number of 

25 channels may range from 10s to 100s to 1000s of channels. Better performance is 
generally achieved with more channels. 

In the preferred embodiment, the analog signal conditioning electronics 1 1 1 
include a pre-amp, a high-pass filter, a band-pass filter, and gain for each receive element 
or channel. Optionally, the gain stages may be time variable and over voltage circuit 
30 protection may be included. Time variable gain is one way of increasing the dynamic 
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range of the system. Optionally, a demodulator stage may also be included in analog 
signal conditioning electronics. In may be preferred to use electronic design techniques 
which minimize the electronics noise generated by the system. 

The analog to digital converter 107 in the preferred embodiment digitizes the 
5 analog signals and outputs the complex number representation components of a signal 
called "In-phase" and "Quadrature" known as I and Q in signal processing. Should, the 
analog converter only produce real output values, the I and Q can be derived from the 
real signal by means of standard signal processing techniques. In the preferred 
embodiment, each channel of acoustic data should be synchronized with the other 
10 channels to be collected at the same rate and at the same time as all the other channels. 
Should there be a time delay between subsequent channels or banks of channels, known 
as multiplexer skew, the signals can be skew corrected for phase comparison processing 
by standard signal processing techniques. 

In the preferred embodiment, bandpass sampling techniques are used. Bandpass 
1 5 sampling reduces data to encompass just the bandwidth needed to cover transmit signal 
plus Doppler shifts. If full bandwidth or over sampling techniques are used, it is preferred 
to digitally filter and reduce the collected data using known digital filtering techniques 
such as comb filtering. The reduction of data though bandpass sampling or digital 
filtering techniques reduces the amount of processing throughput without loss of 
20 information. For high frequency systems, analog signal demodulation may be used before 
digitization to reduce sampling speed requirements. 

The transmit system 1 16 is the component of the system that generates the 
transmitted signal known as a ping. In the preferred embodiment, it includes the signal 
generator 108, the power amplifier 109 and the transducers used for transmission 110. 

25 The signal generator 108 produces the signal to be transmitted though the water. 

In the preferred embodiment, the transmit signal is of finite bandwidth such as a CW 
pulse or frequency modulated signal commonly known as a chirp. Additionally, the 
transmit signal can be phase encoded or use other common signal encoding techniques 
such as Gold Codes and orthogonal coding to distinctly separate multiple pings from one 
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another when used in conjunction with the appropriate matched filter. The multiple pings 
to be separated may be generated by the same sonar system or by multiple sonar systems 
located near each other. In addition to or in place of signal encoding, each ping may be 
confined to a particular and distinct frequency band or group of bands which are separate 
5 and distinct from other pings to allow for ping separation. In the preferred embodiment, 
the signal generator is capable of producing a number of different signals, varying in 
duration, frequency sweep, center frequency, encoding technique or other common signal 
characteristics. 

The power amplifier 109 amplifies the transmit signal to a power level suitable 
10 for transmission through a transmitter 1 10. The transmitter may be a single transducer or 
an array of transducers. Part or all of the transmitter may operate as part or all of the 
receiver by using transmit receive switching commonly known as TR switches. The 
transmitter may be planar, spherical, hemispherical, conformal or other common shape in 
form. 

15 Referring to figure 3, in the preferred embodiment, the sonar system uses a broad 

beam transmitter with a narrow beam receiver 130. In this embodiment a large field-of- 
view is built with a single ping. The transmit beam 131 is used to ensonify a large volume 
of water. Multiple receive elements located in the array face 132 are used to create 
narrow receive beams 133 which can be steered electronically using beamforming 

20 techniques. 

Again referring to Figure 1, in the preferred embodiment, a controller 106 is used 
to synchronize the operation of each of the subsystems in the sonar system. The 
controller may be collocated with any of the subsystems or operate on an independent 
platform. Communication between the controller and any of the subsystems may be 

25 through any convenient digital communications method available such as Ethernet, bus 
level communications, IEE1394, USB, etc. In some cases, the data collection system 115 
may include all or part of the controller. In these cases, the data collection system will 
only interact with the processor 104 indirectly though the communications system 
established by the controller 106. In the preferred embodiment, the controller has the 

30 capability to connect to more than one interface 105 and/or more than one processor. 

10 
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Referring to figure 4a, the sonar system may have a single processor 24 which 
sends information to any number of interfaces 205 which may or may not be collocated 
with the processor. Referring to figure 4b, the sonar system may optionally have multiple 
processors each sending information to one or more interfaces. 

5 In the preferred embodiment, the interface or interfaces 25 can be human user 

display interfaces, human user audio interfaces, machine interfaces, or any such 
combination of the such. Human user interfaces include but are not limited to 2D image 
displays, 3D volumetric displays, 3D rendered stereoscopic displays, heads-up displays, 
lighted alarms, audible alarms, and audible navigation suggestions. Machine interfaces 
10 include but are not limited to digital communication such as Ethernet or serial connection 
to navigation hardware and software API for programming interface. In one embodiment, 
the interface may provide course suggestions to a navigation controller aboard an 
unmanned vehicle or an autopilot steering system. 

Again referring to figure 1, the processor 104 takes digitized sonar data from the 
1 5 data collection system 1 1 5 as its primary input. From the sonar data, the processor is able 
to beamform and produce a data output of space ahead of the vessel relative to the array 
face. In the preferred embodiment, the processor also takes as inputs roll, tilt and yaw 
103, direction information 102, position data 101, vessel speed information 113 and sonar 
depth below water surface information 1 14 from appropriate sensors. The processor in 
20 the preferred embodiment takes all or part of the information from these ancillary sensors 
and creates a 3D image ahead of the vessel with a fixed frame of reference relative to the 
Earth and optionally relative to a fixed position on the Earth. 

The flow chart in figure 5 outlines the process used to extract target data from the 
acoustic data and in conjunction with outside sensors mapping the targets to a fixed frame 
25 of reference. In the preferred embodiment, target detection is initially done through 

correlation of signal strength detections within a set of beamformed data. More advanced 
target detection routines may include classification routines using spectral analysis or 
other common classification techniques. 
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The process begins with a ping transmission 201 . The acoustic reflection signals 
are collected using a 2D array of transducers and a data collection system 202. Each 
hydrophone data channel passes through a matched filter 203 which removes noise from 
the acoustic data. The next step is to select the angles to be used in beamforming 204. 
5 These angles may be pre-selected as configured in the software or as selected by the user 
or controller. In the preferred embodiment, a large range of angles, greater than the 
normal field of view, are pre-selected by the software. The software then determines 
which angles and to what ranges to actually use so as to only process those angles and 
ranges that are within the field of view used by the system. These angles may change 
10 from ping to ping based on the motion of the ship relative to the water and are illustrated 
in figure 6. In the most basic selection of angles to be used in beamforming some range 
may be statically selected in the processing routine and all samples out to some maximum 
radial range may be used. 

Figure 6 shows possible receive beams and their angle relations relative to the 
15 array face 253. Data processing load can be reduced by bounding the volume of interest 
251 by a top boundary 254, a bottom boundary 255, a field-of-view boundary 257 and a 
range boundary 256. These boundaries may be defined based on physical objects such as 
the sea surface or programmatically defined maximums. For example, the top boundary 
may be defined by the sea surface. Since the sonar does not work across the fluid 
20 boundary layer between the water and the air, there can be no data of interest above the 
sea surface and therefore, there processing can be saved by truncating the range of 
processing along any beam that crosses the top boundary at the beam's respective range 
at the top boundary. In the preferred embodiment, beam angles that fall outside of the 
boundaries and the ranges along beams that fall outside of the boundaries can be skipped 
25 to reduce processing load. 

The next step in processing the data is beamforming 205. Beamforming of any 
nature may be used to transpose the data from the time domain to the space domain along 
reference angles. Common beamformers include FFT and DFT based beamformers. By 
using a DTFT instead of an FFT or DFT for beamforming, the subset of angles can be 
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selected differently for different ranges allowing, for example, a smaller subset of angles 
to be processed at longer ranges than those processed at shorter ranges. 

Because of sensitivity to Doppler shifts, beamforming without Doppler 
compensation may not detect all targets at all ranges and angles relative to the array face. 
5 To compensate for Doppler shifts, a signal phase change can be injected into the 

beamformed data where the phase change is a function of Doppler shift. The platform's 
speed can be used to calculate Doppler shift at any beamformed angle relative to the 
array face. In the preferred embodiment, a Doppler correction filter can be applied to 
each beamformed angle. An alternative method is to apply the Doppler correction filter to 

10 the raw hydrophone data before beamforming. By applying the Doppler correction to the 
raw hydrophone data less processing may be required for systems which have fewer 
hydrophone channels than beamformed beams. The consequence of correcting Doppler 
before beamforming is that at high platform speeds, large beamformed angles provide 
large yet regular variations in the Doppler shift. Simply correcting for a single amount of 

15 Doppler shift before beamforming may improve target detection results as compared to 
no Doppler correction, however is not always as effective as using a more 
computationally intensive method of correcting for Doppler after the beamforming. In the 
preferred embodiment, it may be preferred to correct for a number of Doppler shift 
variations based on the platform's speed before beamforming and beamform each set of 

20 Doppler corrected data individually. This process will allow for a larger range of 
corrections and in many cases will yield better results than simply correcting for one 
Doppler shift yet requires less computation than correcting every beamformed angle. 

After beamforming, target data is spatially referenced relative to the array face. 
Compensating for the roll and tilt of the array face 206 is used in the preferred 

25 embodiment to reference the special target data to a fixed frame of reference relative to 
the earth. In the preferred embodiment, roll and tilt sensors with a fixed orientation 
relative to the array face are used to measure correlate the roll and tilt of the array face 
relative to the earth. This not only stabilizes the target data in spatial position from ping 
to ping but also references the data to the earth. Target stabilization without fixed frame 

30 of reference can be achieved through ping to ping correlation where the relative location 
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of a tracked target is compared from ping to ping and used to extract the change in roll 
and tilt of the array face. This technique, however, does not allow for direct relation 
between the target data and the earth for fix frame of reference display and processing. 

After relating the target data to a fixed frame of reference, all processing points 
5 that are mapped above the surface of the water can be removed from the beamformed 
data before submitting the beamformed data to target extraction algorithms. First the 
surface must be found. In the preferred embodiment, the surface location 207 can be 
calculated by taking the depth below the surface information for the array face and 
mapping the target space location to a fixed frame of reference relative to the surface of 

10 the water. Array face depth information may be directly inputted into the processor from 
physical measurements or can be calculated from various depth sensor techniques. 
Additionally, the surface may be extracted from the beamformed data through frequency 
analysis or other classification routines used to identify targets as the air water surface 
boundary. All beamformed data spatially referenced above the located surface can be 

1 5 removed from future processing routines 208. 

In the preferred embodiment of the sonar technology, it may be useful to remove 
surface clutter from the displayed data or data to be processed further for inwater target 
or seafloor detection. Surface clutter may be caused by wave action, bubble fields near 
the sea surface, large numbers of small floating object or other such debris. This 
20 capability is optional and may be selectable if included in the processor's routines 209. 

Rough seas and/or surface clutter can be removed from the sonar display and 
processing by a number of techniques/conditions, all of which can be combined together 
a illustrated in figure 7. These conditions include: remove targets above some certain 
depth, remove targets below some certain target strength, remove targets below some 
25 certain signal level, remove targets within some certain range, and remove targets with a 
given spectral quality. These values and conditions could be set automatically, or set by 
the user. 

In the preferred embodiment, all targets above a certain depth threshold 277 are 
removed from the display and further processing. Additionally, all targets above a certain 
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depth 278 have a higher target size threshold for detection than other generally detected 
targets. Either one or both of these filters may be used to remove surface clutter. 
Additionally, signal classification may be used to only pass classified targets to the 
display or further processing routines. 

5 Referring again to figure 5, another source of noise and false targets can be the 

vessel or platform that the sonar is mounted on itself. In some installations, the 
deployment platform may interfere with the sonar system's field of view. In these cases it 
may be preferred to have the option of removing platform reflections from the data set to 
be processed or displayed 211. Additionally, large targets in the sonar's near-field such as 
10 the boat or other large objects, may cause the raw hydrophone signals to saturate the 
analog electronics and clip the signal. Clipped signals generally do not process well and 
should be in the preferred embodiment removed from the data set. 

Both boat noise and near-field large targets can be removed from the data with a 
spatial filter 212. All signals within the spatial filter can be ignored in processing and the 

15 display. This spatial filter may be made up of a single or multiple boundaries based on 
any 3D volume. A simple example of a spatial filter is a cylinder shape with the axis 
vertically passing through the sonar's array face as illustrated in figure 8. Figure 8a 
shows a vertical slice through a 3D beamformed data with signals from platform 
reflections 301. After removing targets from the volume filtered using the platform noise 

20 removal filter, the platform noise is removed as shown in figure 8b. Advanced filtering 
techniques may include frequency filters and classification techniques to remove only 
specific targets from the filter volume. Platform noise removal filters are optional. 

Referring again to figure 5, after the boat noise removal filter, sea floor detection 
may be optionally processed. If bottom detection is enabled 213, bottom points are 
25 identified within the beamformed data after filtering 214. In the preferred embodiment, 
the bottom is initially found in the beamformed data by searching for the largest absolute 
signal strength return at any given depth for every range and bearing combination. All 
returns from this array of signal peaks over some user defined or software defined 
threshold are determined to be potentially part of the sea bottom. From the array of 
30 potential bottom points, any random outliers are removed. These outliers are points that 
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do not follow the regular pattern of the bottom. Outlier identification techniques may 
include common image processing techniques or other such pattern recognition 
techniques. These techniques may include removing points whose depth, down range, or 
cross range spatial location values do not follow a trend. The bottom detection routine 
5 may include target classification where points that can be identified as bottom materials 
are selected as potential bottom points using spectral or other such signal classification 
techniques. 

Once the bottom is detected, it may be optionally smoothed 215. Bottom 
smoothing is accomplished by passing the potential bottom data though a moving, 
10 weighted average filter 216. The average may be weighted based upon target strength, 
signal strength, and/or other such bottom classification parameters. The values to be 
averaged are spatial location data including depth, cross range, and down range. 

When extracting the bottom surface from the raw data, the bottom may be pitted. 
Some of these pits are caused by constructive and destructive interference in the reflected 

15 signals due to sea floor variations. In an effort to display the data in a clearer format to 
the user, a line of sight filter may be optionally used to produce a more realistic view of 
the data 217. Because this sonar technology is based on line of sight processing, realistic 
bottom depths cannot be measured for points that are hidden behind other targets or 
structures. In the preferred embodiment, a line of sight filter is used to remove depths 

20 points that are hidden from the direct line of sight of the array face due to other objects 
218. In this filter, a ray from the array face through each bottom target is calculated. Any 
bottom targets that fall below the depth of the ray at and range beyond the original target 
are replaced with the spatial location information of the ray's point at the range and 
bearing of the hidden target point. As example, in figure 9, potential bottom points 328 

25 along a 2D vertical slice are shown relative to the array face 326. Line of sight rays 327 
are shown from the array face intersecting each of the potential bottom points. From the 
rays, it is shown that there are a number of hidden bottom points 329 that could not be 
seen by the sonar but are still selected as potential bottom points. The depth, cross range, 
and down range values for these hidden points are changed to the depth, cross range, and 
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down range values of the corresponding range along the line of sight ray. With the 
corrected points, a line of sight corrected bottom profile can be made 330. 

In the preferred embodiment, the line of sight filter can be used in the both the 
vertical and the horizontal to remove target ambiguities caused by multipath as illustrated 
5 in figures 10a and 10b. By approaching the sonar problem from a navigation point of 
view, issues pertaining to multipath, which normally limit the performance of many sonar 
technologies, are eliminated once multiple dimensions are processed simultaneously. 
Given a known location of the sea floor 338 and the sea surface, all multipath false 
targets 336 in the vertical can be eliminated because they fall either above the surface or 

10 below the sea floor as shown in figure 10a. Bottom target extraction routines can be used 
to detect the sea floor. Additionally, the surface location is known from depth sensors or 
user defined depth placement of the array face 339 combined with roll/tilt detection 
electronics. When the system does not operate in a sub-bottom mode, ambiguities can be 
eliminated. This solution is only appropriate for a 3D image ahead of vessel with fixed 

1 5 frame of reference for navigation. 

This same concept can be implemented in the horizontal since the technology is a 
line of sight system and we do not process targets that are behind other targets. An 
example of when multipath may become an issue in the horizontal is when a large in 
water target like a vessel 341 is near a large vertical reflector like a bulkhead 342 such as 
20 illustrated in figure 10b. In this case, both sets of targets fall with in the filed of view 345 
of the sonar system located aboard a ship 344 and therefore, multipath images of the 
target vessel may be reflected by the bulkhead creating false targets 343. 

Referring again to figure 5, in the preferred embodiment, in-water targets may 
optionally be extracted from the beamformed data and displayed with or without bottom 
25 mapping in conjunction or exclusively from sea bottom targets 219. In-water targets can 
be initially found by finding local peaks in the absolute signal strength data. Any local 
peak that is not part of the sea bottom data and has not been filtered out through previous 
filtering techniques and are above a certain signal strength threshold can be considered an 
in-water target 220. 
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In the preferred embodiment, these in-water targets can be displayed as voxels or 
other images in 2D and 3D representations. The size of the displayed object may be a 
function of target strength or a function of the beamwidth of the target at the detected 
range. The color and alpha blending of the displayed objects may be mapped to depth 
and/or signal strength. Additionally, icons may be used to represent common targets or 
target groups. Representations of the inwater targets may be displayed independently of 
any bottom maps and may be exported to other navigation, classification, tracking, or 
control devices independently from the bottom map data. In the interface software, the 
user may in the preferred embodiment have the ability to select particular targets or target 
groups with a mouse or other pointing device. Once selected, the display interface may 
have the ability to display additional information about the target such as target strength, 
signal strength, range to target, bearing to target, depth of target, speed of target, relative 
speed of target, time to collision, etc. These advanced display capabilities are optional. 

In the preferred embodiment, the user may have the option to classify some or all 
of the targets 221 . Target classification may be using a number of classification 
techniques such as frequency analysis, matched filtering, image processing, wavelet 
technology, neural network technology, passive listening, or other signal classification 
routines 222. Target classification may be used to filter out unwanted targets from the 
display or other processing routines. 

After extracting targets from beamformed data, the preferred embodiment has the 
option of testing various alarm conditions 229. Multiple user definable and system 
defined alarms may be present which may alert the user or other navigation, 
classification, tracking, or control devices or alert conditions. Multiple alarm conditions 
can be tied together. These alert conditions may include but are not limited to the 
notification of a depth less than some minimum depth, the notification of a depth greater 
than some maximum depth condition, the notification of a target within some minimum 
range, the notification of a target within some cross range or bearing range from the 
vessel's path or some definable bearing, the notification of what the minimum depth is 
along some heading or within some area, the notification of a target along a collision 
course, the notification of a target that is persistent from more than one ping, the 
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notification of a particular type of target, the notification of target within specified field 
of view, the notification of bottom detected, the notification of no targets present, the 
notification of a moving target, the notification of a stationary target, and/or the 
notification of targets beyond some range. 

If any of the alarm conditions are met, the alarm should be sounded 231. In the 
preferred embodiment, the alarm can be sounded by audible and/or visual alarms in the 
user interface display and/or stand alone alarm consoles. Additionally, alarm notifications 
can be sent via electronic communication methods such as serial or Ethernet 
communication to other system interfaces such as autopilots, voyage logs, and other 
control systems. 

Once targets are located, in the preferred embodiment, the system may optionally 
provide navigation recommendations 223. By analyzing the localized targets using 
common image processing, neural networks, or other signal processing techniques, the 
system is able to identify obstacles to navigation and make recommendations to user or 
other navigation or control systems regarding navigation decisions. These decisions may 
include but are not limited to turn left, turn right, slow down, speed up, stop, reverse 
direction, dive, climb, sound a horn, ring a bell, and/or transmit a call via radio or other 
electronic communication device 224. These decisions can be displayed to the user via 
graphics, transmitted to the user with audio signals, or sent to a navigation or control 
system via common electronic communication methods 225. 

In the preferred embodiment, after processing all the data with various stages of 
filtering, alarms, and conditions, the processed data is then sent to the display interface 
for user interaction 226. In the preferred embodiment, the display has the option of 
utilizing geo-referencing to create a sonar image referenced not only to a fixed frame of 
reference but also a fixed location on earth 227. If this option is enabled and geo-location 
reference sensor data is available such as GPS, loran, and/or compass information 229, 
the sonar data can be mapped to it earth location relative to the earth and relative to the 
vessel 228. In the preferred embodiment, once sonar data is geo-referenced to the earth, 
historical data can be displayed it its geo-referenced earth position relative to the position 
of other pings. These displays can include historical depth profiles at previous vessel 
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positions and adjusting the position of the vessel graphic relative to a fixed geo- 
referenced location or the sonar data on the sonar data display. The movement of the 
vessel depicts the actual location of the vessel relative to the sonar targets as the vessel 
moves between pings. Should geo-positioning data not be available, historical data can be 
displayed with incremental spacing as a function of time passed or continually referenced 
to the vessel. Optionally, brightness, targets size, target color, and/or alpha blending 
properties of a displayed target can be used to depict the time history of the historical 
data. One example would be the persistence of older sonar data on top of newer sonar 
data with the older sonar data becoming dimmer and dimmer until it is not displayed. 

In the preferred embodiment, once the sonar data has been referenced to a fixed 
frame of reference, it may be combined with radar information from a separate radar 
sensor enabling the display to show both below the water images with the sonar data and 
above the water images with radar at the same time in the same display. Additionally, 
with geo-referencing enabled, sonar and radar information can be overlayed on top of an 
electronic navigation chart with both the sonar and the radar data displayed with geo- 
referencing. 

In addition to these displays, in the preferred embodiment, raw beamformed data 
or partially processed data may be displayed in conjunction with processed data in the 
same view. Processed data such as algorithm extracted bottom maps and in water targets 
can be displayed on top of raw data. In figure 1 1, a vertical 2D slice through 3D data has 
been taken with the color/alpha mapped a signal property such as target strength or signal 
strength. On top of the raw data 352, the bottom profile extracted from processing 
routines is also drawn 351. The raw beamformed data may allow the user to better 
understand what type of target the system has detected. Colors/alpha may also be mapped 
to depth or other sonar properties. This display concept can be combined with target 
persistence. This display does not require a profile slice and may be used with other data 
displays such as 3D data sets and chart overlays. 

Abstract 

An imaging sonar system develops three-dimensional images of the space below, 
to the sides, and forward of a ship relative to a fixed frame of reference. Various features 
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